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[57] ABSTRACT 

llie method herein images an object repeatedly moving 
about an axis, llie method uses signals to track the object's 
position with respect to the axis while a camera views the 
object. A reflection is cast from the object toward the camera 
in such a way that the camera scans both the reflection and 
the object. The camera outputs representations of video 
lines, which depict parts of the object and the reflection. 
These video lines have known positions relative to a refer- 
ence plane, which passes through the image plane of the 
camera. Certain of the video lines are selected. The selected 
hnes come from a chosen position relative to the reference 
plane and occur within a chosen time of the position signals. 
The selected video lines are arrayed according to their 
particular position signals and are used to compile a planar 
composite image representing the object's outer periphery. 
The composite image is conformed to a shape resembling 
the periphery, thereby creating a three dimensional repre- 
sentation of the object. 

6 Claims, 4 Drawing Sheets 
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1 2 

METHOD OF INFRARED IMAGING FIG. 2 Ls shows the juxtapositions of reference planes to 

GOVERNMENT USE ^''^ ^ '''^^''^ 

™. j-vju u J jj FIG, 3 is a view of the tire as seen by the camera. 
The mveniion dcscnbed here may be made, used and 
licensed by or for the U.S. Government for governmental . FIG. 4 is the view of FIG. 3 wherem images of the 
purposes without paying us royalty. ^ reflections have been reversed. 

BACKGROUND ^ ^^V^^^^^^ a planar composite image of the lire 

produced by our process; 

Our method constructs composite images of outer sur- ^ . . . r u . l- u .i. 

c c • • 1 • •_• if/ J J FIG. 6 is a perspective view of a shape onto which the 

faces of spinning or loopmg objects. We use standard, ■ c i^ir^ e • j 

, . , .'^ ^. • 11 1 LI I in composite imaee of no. 5 IS wrapped, 

relatively inexpensive, commercially available video pro- » 

cessing equipment. We build upon and modify the basic ^ is a view along line 7—7 in FIG. 6 representing a 

method of U.S. Pat. No. 4,970,597 to Shepard entitled C''^^ ^^^^^^ °f ^^e FIG. 6 shape. 

"Method to Image High Speed Events Using A Standard FIG. 8 represents the larger of two computer memory 

Video Camera," which constructs composite images of high arrays used in our method. 

.speed events. FIG. 9 represents the smaller of two computer memory 

In U.S. Pal. No. 4,970,597, a series of individual video arrays used in our method, 

camera hne signals are selected from video frames imaging piG. 10 illustrates the effect of using multiple viewing 

recurrences of a repeating event. U.S. Pat. No. 4,970^97 angles under our method 

uses an aperture signal 36 whose signal points 38 occur a ^ represents an image of the tire compiled from the 

predelermmed lime before a video camera hne signal begins. j^^^^^^j ^^^^ ^-^^^ ^^^^^ ^ ^. 

A nagging sign a 132 occurs a constant time c before each ^\ *• , t 

^ = , , , , . position relative a reference plane, 

recurrence ol the event. In essence, the temporal juxtaposi- . , . r . • • 

lion of flagging signal 32 and a signal point 38 indicate how J^^.' is the image of HG. 11 wherem images of the 

close in time the recurrence is to the onset of a camera video reflections have been reversed. 

line signal. If the recurrence is close enough to the onset of FI<^'- ^3 represents an alternative to the FIG. 7 cross 

the line signal, then the line signal is used in constructing a section. 

composite image of the event. FIG. 14 represents a portion of the composite image 

Instead of a flagging signal, we use rotational position depicting a part of the tire sidewall. 

signals generated by a shaft encoder. Each rotational posi- FIG. 15 illustrates the raster pattern of the camera, 
lion signal corresponds to one of a multiplicity of known 

angular positions of a spinning object such as a tire. Each DETAILED DESCRIPTION 

rotational signal can be regarded as an indicator of a pj^ j ^ ^ semi -schematic diagram of an apparatus to 

recurrence of an event, which is the spinmng object's arnval take a 360° image of the entire outer periphery of an object 
at one of its known angular positions. If the event occurs ^, such as a tire 10 spinning about a single axis 28. Optionallv, 

within a selected time of the beginning of a given video line apparatus can image a sector of tire 10, or can image anv 

signal from a camera, then the given hne signal is a object that orbits about an axis. The apparatus can h\so 

candidate for use m construction of a composite image of the in^agc entire drive belts or chains, segments thereof, or anv 

spinning object. The given line must meet further criteria of objects which have a plurahty of axes around which thev 

our method before it is used for the composite image. i^^p ^ closed path. Additionally, the apparatus can image 

SUMMARY continuous moving stock of items such as paper or cable 

Our method images an object undergoing repeated circu- ^^""^ a manufacturing process, 

lalory motion about one or more axes, or an object spinning '^^^^ ^'^y ^""^^ °^^"ner of tread on its 

about a single axis. Our method uses signals to track the diametrical surface 14. Tire 10 mounts on axle 16. 
object's position with respect to an axis as a camera scans ^5 which spins at a speed controlled by motor 18. Shaft encoder 

the object. Mirrors cast reflections from the object toward ^0 senses the rotational position of lire 10 and outputs a 

the camera so that the camera scans both the reflections and ^^^^^^ representing that position. In our apparatus, shaft 

the object, the reflections being diff^erenl views of the object encoder 20 sends a .signal at each of 1024 equal angular 

than the camera's view. The camera sends out signals divisions corresponding to positions of tire 10 relative to 

representing either horizontal or scan video lines which ^^^^ ^8. Shaft encoder 20 is connected to tire 10 by a 

depict parts of the object and parts of the reflections, the speedometer cable 22 or the like or can be connected to tire 

video hues having known positions relative to a reference ^ "5^^ shaft axially ahgned with axle 16. Tire 10 bears 

plane. Given horizontal or scan video lines are of interest if °^ ^ ^ pressure like that of a tire supporting a 

they come from a chosen position relative to the reference ^^^^^^'^^ ^n the ground, and roller 8 spins with tire 10. Tire 10 
plane and occur within a selected time of a position signal. 55 can rotate at speeds typical of vehicle travel, SQ the tirc' ^ 

The lines of interest are given identifiers corresponding to contact w ith roU patterns in the tire like^ 

the particular position signal they are nearest to. llie lines of T HoSe-pToauccd by ^"St^way ira vel^ 

interest are arrang ed in an array accordi n g to their particula r Keferrmg now to Mub. i an'^Xl nfrarcd catperaj laim^ 

p osition sig ng k anH ari- ii^f^ ^ rn com pile ^ flM rf^mpo^ilA at jjre 10 so as to get a direct view of smlaix 14. We 

miflgfi nf ihp n hiect's outer periphery. The composite image contemplate tnai camera 24 will normally be essentially the 

is then ^raphicflllv wrap ^ or comptlter mapped onto a" same, and will normally operate in essentially the same way, 
s hape resembling the obj ect's outer surface, i hKreh y prn7 as the camera used by Shepard in U.S. Pat. No. 4,970,597, 

ducing an image which can be viewed from any antd e. discussed previously. Camera 24 has a raster pattern 4 

;r;;,^^ ,^r.r.^T,.™^.T ™ ,^ .,,..,^1^ comprising a set of parallel lines 6. as seen in FIG. 15. 

BRIEF DESCRIPTION OF THE DRAWINGS Camera 24 is orienied so .hat .he raster pattern intersects a 

FIG, 1 is a semi-schematic depiction of the apparatus used reference plane 26 and so that individual lines of the raster 

in our method. pattern are parallel both to reference plane 26 and lo tire axis 
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28. Camera 24 may also be a staring mode camera simul- SO lo be larger than array 48 so thai array 50 can store 

taneously producing a multiplicity of horizontal video lines, sufficient data to represent all of tire 10 with the quality of 

wherein plane 26 intersects the focal plane array of the resolution that we desire. 

camera. It is, of course, possible for horizontal or scan lines to be 
Reference plane 26 may be regarded as intersecting the 5 taken directly from camera 24 to array SO, thereby elimi- 

cameras's image or focal plane 30, which is represented by °^*"^g ^^V^.^V ^8. However, for the parUcu ar 

a dashed line. In FIG. 2, reference plane 26 is a horizontal f me^a^sed m developing oar method taking lines directly 

, • u i_ • II c from the camera would require modiryme the rather com- 

plane passmg through tire axis 28. However, reference . i ■ u u- u .u ♦ i» 

. . . . i r plex proerara loeic by which the camera operates. It was 

p anes can be at other onentalions. For exainple, reference ^^^^ convenient to utilize array 48 than to modify 

planes 32 and 34 pass through image plane 30, are parallel lO camera's program logic. 

to axis 28 and are tangent to the radially nriost outward part ^ g ^ ^ ^^.^ ^^^^^ 

ot the tire. It is preferred to aim camera 24 directly at tire 10, ^^^^^^ rt^rc^m horizontal or scan lines 250 pixels 

so that camera 24 aims along plane 26 toward axis 28. ^^^^^ ^^^^y 5^ ^^^^-^^ ^^24 such lines. Each line in array 50 

At either side of tire 10 and opposing its sidewalls 36 are is in an array position associated with one of the 1024 

stationary flat mirrors 38, which reflect images of the rotational positions of tire 10 sensed by shaft encoder 20. As 

sidewalls to camera 24. Mirrors 38 arc shown in dashed lines lines arc transferred from array 48 to array 50, they are 

in FIG. 2. The function of mirrors 38 is to provide added renumbered or re -indexed. That is, lines stored in array 48 

views of tire 10 taken from different vantage points, the will have been numbered from 0 to 249, but are given a new 

added views ultimately going to the same frame grabber as number or other identifier corresponding to the appropriate 

the view of lire 10 seen directly by camera 24. The added rotational position signal from shaft encoder 20. These lines 

views can be gotten bv means other than flat mirrors 38, as ^re placed in array SO in accordance with their new number, 

by auxiliary cameras 'aimed at sidewalls 36 or bv cur\'ed ^^^^ ^ ^^"^ number 726, for example, enters 

mirrors. However, flat mirrors 38 are preferred. ' ^"^^ ^* ^ location associated with rotational position 726. 

1 u • r .u * • * f -^A In selecting lines from array 48 for transfer to array 50, we 

FIG. 3 shows a view from the vantage point of camera 24 f . . 1 i- r 1 ... ao ^ 
, , , . .1. ■ • , J r . -5 preier to take lines from only one position m array 48. In this 

looking along plane 26 where the view mcludes part of the ^^^-^ ^-^^^ representing portions of tire 10 that are 

tire s outer diametncal surface 14, reflected images 36' of ^^^^^^^ disitinc^s from camera 24 or that are along 

sidewafls 36 and reflected side views 12' of knobs 12. In different angles from camera 24. The problem is illustrated 

conventional fashion, camera 24 scans lines of the view exaggerated fashion in FIG. 10, where a line taken of 
represented by FIG. 3 as the camera executes its raster 3^ location 56 on round object 58 is at a different distance than 

pattern. Video .signals representing these scan lines are sent location 60 from camera 24. location 56 is along a line of 

to computer 40 (FIG. I) along communication line 42. sight 62 and location 60 is along line of sight 64, and these 

Alternately, video signals representing horizontal lines from Hnes of sight are at a different angles with respect lo camera 

a staring mode camera are sent along line 42 . As line signals 24. 

are sent along line 42, signals from shaft encoder 20, which In our method, any selected line will normally be one that 

represent the tire's rotational position, are sent 10 computer is most centrally located in array 48 or the raster pattern of 

40 along communication line 44. After various signal pro- camera 24, as is line 54 at array position 125 in FIG. 9. Line 

ccssing operations, computer 40 can send images to monito r 54 will either be in reference plane 26 or will be the closest 

46 a]ong communication line 49 or can store the images horizontal or scan line to reference plane 26. Thus line 54 

inlernafly . represents an available view taken most nearly perpeudicu- 

Computcr 40 has a conventional frame grabber whose la r to the tire's outer diametrical surface 14. Optionally, line 

data storage buffer or array 48 is represented by FIG. 9. 54 can be in any array position between 0 and 249 in FIG. 

Array 48 holds one video frame from camera 2 4. Also within 9 and can be in any reference plane between planes 32 and 

computer 40 is a memory storage having buffer or array 50 , 34 in FIG. 2. 

' communicated to array 48 and represented bv Fi n 8 Array The selected lines must have a predefined temporal close - 

48je smaller of the two array.^, smrps «;ignak frnm rampra ness to a rotational position signal. To achieve temporal 

24 representing a multiplicity of horizontal lines or scan closeness in our method, the selected lines begin within a 

lines/The horizontal line or scan line data is represented by chosen time span of a rotational position signal from shaft 

dotted hnes such as those seen at 52 and 53 in FIG. 9. The encoder 20. The lime span chosen generafly shortens at 
particular array represented by FIG. 9 is a 250x250 array, 50 increasing angular speeds of tire 10 or when higher image 

which means that each dotted line represents a scan line that quality is desired. A line which has the proper array position 

is 250 pixels long and that 250 scan lines are represented. and is temporally close enough to the rotational position 

The horizontal or .scan lines are each assigned a unique .signal is deemed a "line of interest'' within a frame imaged 

sequential identifier number, which ranges from 0 to 249 and by camera 24. 

which represents a unique position within the raster pattern 55 Frames representing sectors arc of tire 10 are continu- 

of camera 24. The first horizontal or scan line is at the top ously captured and lines of interest are continually selected 

of FIG. 9 and is assigned the "0" identity number and the last and sent to array 50. In FIG. 8, for example, hnes of interest 

line is at the bottom of FIG. 9 and is assigned the '*249" 66 and 68 are a'l respective array locations 98 and 512. The 

identity number. processes of capturing and selecting continue until at least a 
At any given instant, camera 24 views only a sector of tire 60 given number, n, of lines has been sent to each of the 1024 

10. Hence array 48 shows only the sector of the tire in the positions in array 50. Frames not containing lines of interest 

frame imaged by the camera as the frame grabber captures are disregarded. 

the frame. In order lo build a composite image of the whole Taking place at each array location is a determination of 

tire 10, we use selected lines from numerous frames cap- averages for each pixel location in the selected lines. A 
tured at different instants, until suflBcieni lines have been 65 number of averaging techniques can be used but we prefer 

acquired to build the composite image. The selected lines arc 10 use a moving weighted average calculated according to 

moved from array 48 to the larger array 50. Wc prefer array the formula: 
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where X^,^^ is the moving weighted average for the pixel 
location, Xj, Xj, X3 . , . X„ are respectively the first, second, 
third and nlh pixel values sent to the pixel location. For a 
plurality of pixel values, the formula gives the last received 
value a 50% weight and all previous values combined 
receive a 50% weight. By this method of calculating an 
average, the most current data has the greatest effect on the 
average, in addition, this method of average calculation uses 
less memory capacity and permits faster image processing 
than other methods. 

In our method, the images 36' of sidewalls 36, as well as 
the images 12' of knobs 12, are reversed. The reversal can be 
such that image 36' on the left side of FIG. 3 is turned on its 
axis to become the reversed sidewall image 36" on the left 
side of FIG. 4; and similarly, image 36' on the right side of 
FIG. 3 is turned on its axis to become the reversed sidewall 
image 36" on the right side of FIG. 4. Images 12' of knobs 
12 become images 12". The reversal can be done by appro- 
priate lenses or mirrors optically between sidewalls 36 and 
camera 24. Alternatively, standard image processing tech- 
niques can be used, such as reversing portions of horizontal 
lines or scan lines representing sidewalls 36. Particularly, if 
horizontal or scan lines from only one position in array 48 
are sent to array 50, then the scan line reversal technique 
explained below can be used. 

FIG. 11 is a portion of the composite view of tire 10 that 
would held in array 50 if lines from only one array position 
in array 48 were sent to array 50. One effect of using lines 
from only one of array 48 's positions is that sidewall images 
36rt in FIG. 11 are straight and not curved as the analogous 
sidewall images 36' in FIG. 3. Image 36fl is reversed about 
center line 70, which bisects image 36i7, and image 36ft is 
reversed about center line 72, which bisects image 366. Tlie 
re.sulting sidewall images are shown resjiectively at 36fl' and 
My in FIG. 12. 

At least in some instances, there will be gaps between 
images of the lire's outer diametrical surface and images of 
the tire's sidewalls. Straight gaps of dimensions "d" and "e" 
are in FIGS. 11 and 12 and other gaps are at 74 and 76 in 
FIG. 3 and at 78 and 80 in FIG. 4. In FIG. 12, known image 
processing techniques can be used to eliminate the gaps of 
dimensions "d" and '*e." This is done, for example, by 
indexing pixels of images 36fl' and 366' along axis 28 until 
these images abut image 14" of the tire's outer diametrical 
surface 14. llie pixels of image 36^' all index the same 
amount and the pixels of image 366' all index the same 
amount. In FIG. 4, a somewhat similar operation can be 
done, but pixels of images 36" index according to their scan 
lines' vertical distance from reference plane 26, pixels of the 
vertically more distant lines indexing further horizontally. 
Images 36*' of the sidewall are straightened, and will thus 
exhibit the general configuration of images 36^' and 366*. 
Images 36" will be in abutting line contact with the image 
of outer diametrical surface 14. 

After removal of gaps between images shown in either 
FIG. 12 or FIG. 4, the composite image 82 of the entire outer 
peripheral surface of tire 10 will appear as the planar strip 
shown in FIG. 5. Lines 84 and 86 are at the boundaries 
between image 14" of the tire's outer diametrical surface 14 
and images 36a' and 366' of the lire's sidewalls 36. 

The next step in our method is to wrap composite image 
82 onto a three dimensional annular shape such as that 
shown at 88 in FIG. 6 so as to produce a three dimensional 
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representation of tire 10. Thus operation is done by the use 
of commercially available software. In developing our 
method, we used SIMPLY 3D^" software produced by 
Visual Software, Inc. 

5 Shape 88 comprises two fiat ring-like surfaces 90 and 92 
joined at their outer diameters by cylindrical surface 94, so 
that shape 88 has the rectangular "U" cross section shown in 
FIG. 7. Shape 88 may be replaced by another three dimen- 
sional shape 96 having the radial cross section shown in 

10 FIG. 13, shape 96 more nearly representing the cross section 
of tire 10. For purposes of illustration surfaces 90, 92 and 94 
are shown in FIG. 6 with arbitrary, different hatching, but 
shape 88 can be represented by a wire frame diagram as 
well. 

15 FIG. 14 shows a portion of image 366' after composite 
image 82 has been wrapped on shape 88. The image will be 
comprised of processed scan line portions 98 which con- 
verge as they approach inner diametrical edge 100. Tlie 
software used to wrap image 82 onto shape 88 adjusts for the 

20 image intensifying effect of line convergence so that the 
portions of image 366' nearer edge 100 do not appear unduly 
bright. 

We wish it to be understood that we do not desire to be 
limited to the exact details of construction or method shown 
25 herein since obvious modifications will occur to those 
skilled in the relevant arts without departing from the spirit 
and scope of the following claims. 

What is claimed is: 

1. A method of forming a three-dimensional image of an 
30 object moving around at least one axis, comprising: 

producing position signals indicating positions of the 
object relative to the axis; 

aiming a camera at the object along a first line sight so that 
the camera has a first view of the object; 

obtaining a second view of the object, the second view 
taken along a second line of sight generally perpen- 
dicular to the first line of sight; 

directing the second view to the camera; 
40 wherein the camera sees the first view and the second 
view, the camera outputling representations of video 
lines depicting parts of the first view and parts of the 
second view; 

selecting the video lines occurring within predetermined 
45 times of the position signals; 

indicating the video lines selected with identifiers corre- 
sponding to the position signals, wherein each indi- 
cated video line is associated with a particular position 
signal; 

50 using the indicated lines to form a flat composite image 
representing the object; 
providing a three-dimensional shape resembling the 
object; and 

,^ folding the composite image onto the shape. 

2. The method of claim 1 wherein: 

the object comprises a side component and another com- 
ponent connected to the side component; 

the first view is a direct view by the camera of the another 
60 component; and 

the second view is an image of the side component, a 
second view being reflected toward the camera. 

3. The method of claim 1 wherein: 

the object comprises two side components and another 
65 component connecting the side components, a region of 
one side component being opposed to a region of 
another side component; 
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the method further includes obtaining a third view of the 
object taken along a third line of sight having a gen- 
erally opposite direction to the second line of sight, and 
sending the third view to the camera; and 

each of the views is of a different one of the components. 

4. The method of claim 1 wherein: 

the camera has an image plane containing the video lines; 
selecting the video lines includes picking video lines only 
from a certain position in the image plane. 

5. The method of claim 4 wherein the certain position is 
the position least distant from a reference plane containing 
the one axis and lying perpendicular to the image plane of 
the camera. 

6. A method of imaging the entire exterior of an object 
wherein the object moves around at least one axis, the object 
having one region encircling the axis and facing radially 
outward relative to the axis, the method comprising: 

producing position signals indicating positions of the 
object relative to the axis; 

aiming a camera along a first line of sight so that the 
camera has a first view of the object; 

obtaining a second view of the object, the second view 
taken along a second line of sight generally perpen- 
dicular to the first line of sight; 



20 



directing the second view to the camera; 

obtaining a third view of the object taken along a third line 
of sight having a generally opposite diirection to the 
second line of sight, and sending the third view to the 
camera; 

wherein one of the lines of sight is generally perpendicu- 
lar to the axis and is aimed toward the one region; 

wherein the camera sees the first view and the second 
view and the third view, the camera outputting repre- 
sentations of video lines depicting parts of the first view 
and parts of the second view and parts of the third view; 

selecting the video lines occurring within predetermined 
times of the position signals and lying least distant from 
a reference plane passing both through the axis and an 
image plane of the camera; 

using the selected lines to fonm a flat composite image 
representing the object; 

providing a three-dimensional shape resembling the 
object; and 

folding the composite image onto the shape. 



05/22/2002, EAST Version: 1.03.0003 



